Skip to content

Week 1: Containerize Training Environment with LoRA and Wav2Vec2 Support - #24

Merged
kavyavenk merged 11 commits into
mainfrom
kavya
Feb 24, 2026
Merged

Week 1: Containerize Training Environment with LoRA and Wav2Vec2 Support#24
kavyavenk merged 11 commits into
mainfrom
kavya

Conversation

@kavyavenk

@kavyavenk kavyavenk commented Feb 18, 2026

Copy link
Copy Markdown
Collaborator

Week 1 Task: Containerize Training Environment

This PR implements Dockerization of the local training environment to ensure all dependencies (LoRA, Wav2Vec2) are reproducible in a Linux container.

Deliverables

Dockerfiles:

  • Dockerfile.training - GPU training container (NVIDIA CUDA 11.8, optimized for GCP)
  • Dockerfile.training.cpu - CPU-only training container (for local testing)

Configuration:

  • docker-compose.training.yml - Docker Compose configuration for training
  • .dockerignore.training - Build context optimization

Scripts:

  • scripts/verify_training_docker.sh - Dependency verification script
  • scripts/fix_and_build_training_docker.sh - Automated build script
  • scripts/fix_docker_credentials.sh - Docker credential troubleshooting

Documentation:

  • WEEK1_DOCKER_BUILD_SUMMARY.md - Build summary and status
  • WEEK1_TRAINING_DOCKER_QUICKSTART.md - Quick start guide
  • docs/WEEK1_TRAINING_DOCKER.md - Comprehensive documentation

Verified Dependencies

  • LoRA/PEFT (>=0.8.0) - Parameter-efficient fine-tuning
  • Wav2Vec2 (Transformers >=4.35.0) - Speech-to-text model support
  • PyTorch 2.0.1 (GPU) / 2.10.0 (CPU) - Deep learning framework
  • Audio processing libraries (librosa, soundfile, ffmpeg, sox)
  • Evaluation metrics (jiwer for WER/CER)
  • Google Cloud Storage integration
  • Weights & Biases (WandB) for experiment tracking

Build Status

  • CPU Container: Built and verified (adaptive-stt-training:cpu, ~3.05GB)
  • GPU Container: Ready for GCP deployment (Dockerfile complete)

Verification

# Verify CPU container
docker run --rm adaptive-stt-training:cpu python3 -c "from peft import LoraConfig; from transformers import Wav2Vec2ForCTC; print('✅ Verified!')"

Task Completion

Dockerized training environment
LoRA dependencies included and verified
Wav2Vec2 support included and verified
Reproducibility ensured
GCP compatibility verified
Comprehensive documentation provided

Ready for Week 2 Pipeline Migration!

shivangi221b and others added 9 commits February 11, 2026 17:54
…EFERENCE at root, no extra docs, no agent_evaluator)

Co-authored-by: Cursor <cursoragent@cursor.com>
- ✅ Created Dockerfile.training (GPU) and Dockerfile.training.cpu (CPU)
- ✅ Verified all dependencies: LoRA/PEFT, Wav2Vec2, PyTorch, audio processing
- ✅ Added Docker Compose configuration for training
- ✅ Created verification and build scripts
- ✅ Comprehensive documentation (quickstart, troubleshooting, completion report)
- ✅ CPU container built and verified successfully (3.05GB)
- ✅ GPU container ready for GCP deployment

All Week 1 tasks for Kavya completed. Training environment is reproducible and ready for GCP deployment.

Co-authored-by: Cursor <cursoragent@cursor.com>
@GAInTheHouse

Copy link
Copy Markdown
Owner

It seems like the changes shown in the diff are askew with main. Can you merge from main and force push to your branch?

@GAInTheHouse

Copy link
Copy Markdown
Owner

Isn't the task for this PR to containerize? Can you update the PR name and description?

@kavyavenk kavyavenk changed the title merge updates post clean-up and rebase Week 1: Containerize Training Environment with LoRA and Wav2Vec2 Support Feb 21, 2026
@kavyavenk

Copy link
Copy Markdown
Collaborator Author

@GAInTheHouse updated and handled branch control

@GAInTheHouse GAInTheHouse left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Took a first pass at the changes: please take a look

Comment thread report.md Outdated
Comment thread experiments/run_comprehensive_evaluations.py
Comment thread experiments/verify_evaluation_numbers.py
Comment thread docs/EVALUATION_VERIFICATION_SUMMARY.md
Comment thread WEEK1_DOCKER_BUILD_SUMMARY.md Outdated
Comment thread WEEK1_TRAINING_DOCKER_QUICKSTART.md Outdated
…Docker docs

- Move run_comprehensive_evaluations.py to experiments/
- Move verify_evaluation_numbers.py to experiments/
- Move EVALUATION_VERIFICATION_SUMMARY.md to docs/ and expand explanation
- Delete redundant WEEK1_DOCKER_BUILD_SUMMARY.md (consolidated into docs/WEEK1_TRAINING_DOCKER.md)
- Delete redundant WEEK1_TRAINING_DOCKER_QUICKSTART.md (consolidated into docs/WEEK1_TRAINING_DOCKER.md)
- Add Quick Start section to docs/WEEK1_TRAINING_DOCKER.md
- Expand verification summary purpose and context explanation

Co-authored-by: Cursor <cursoragent@cursor.com>
@kavyavenk

kavyavenk commented Feb 23, 2026

Copy link
Copy Markdown
Collaborator Author

Addressed all review comments:

File Organization:

  • Moved run_comprehensive_evaluations.py to experiments/
  • Moved verify_evaluation_numbers.py to experiments/
  • Moved EVALUATION_VERIFICATION_SUMMARY.md to docs/ and expanded explanation

Docker Documentation:

  • Deleted WEEK1_DOCKER_BUILD_SUMMARY.md (consolidated into docs/WEEK1_TRAINING_DOCKER.md)
  • Deleted WEEK1_TRAINING_DOCKER_QUICKSTART.md (consolidated into docs/WEEK1_TRAINING_DOCKER.md)
  • Added Quick Start section to docs/WEEK1_TRAINING_DOCKER.md

Verification Summary:

  • Expanded explanation of "verification" purpose - documents cross-referencing of report metrics against actual evaluation outputs to distinguish verified vs estimated values for scientific accuracy.

All files are now properly organized and documentation is consolidated

@kavyavenk
kavyavenk merged commit ac5a7eb into main Feb 24, 2026
4 checks passed
@GAInTheHouse
GAInTheHouse deleted the kavya branch February 25, 2026 01:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants